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EXECUTIVE SUMMARY 
of the 

- u 'PILOT ENRICHMENT PROGRAM (PEP) < 

The Pilot Enrichment Program (PEP) has completed its second year of 
• operation. This project was^iesigned as an intensive college preparatory 
program for underprepared ninth .and-tenth grade high school students. The 
program combined the resources of Carver High School and Hyde Park Academy 
along with the University of Chicago. 

Classes were held three days a week at the students' respective high 1 
schools and for the remaining two days in the week at the University of 
Chicago. Prior to the school year, the students were enrolled in an eight, 
week summer session. , The PEP project was organized to include participation 
in a. wide -range of cultural- activities, enriched academic classes, tutoring 
programs and visits to college campuses. *- 

This evaluation analyzed the outcomes of the two program objectives 
which included the measurement of academic achievement and adaptability to 
high school, respectively. Ninty-four students began the school year with 
PEP. During the year, 21 students dropped from PEP f with the majority of this 
group not attending the summer session. The remaining 73 "students comprised 
the population of this evaluation. A control group of 51 students from the 
two PEP high schools was utilized for comparison with the PEP 'participants 
on each of the outcomes analyzed in the two program objectives. 

The measurement of academic achievement included the comparison the 1 
PEP students, with the control group on pretest and posttest score differences 
on the Reading, Language Arts and Mathematics subtests of the Iowa Test of 
Educational Development , No significant differences were found between the 
two groups of students, on the Reading and Language Ar£s tests. However, 
significant differences were found on the Mathematics test favoring the PEP 
stildents. Much of this statistical difference occurred because the PEP males 
scored significantly higher on the posttest than the pretest, while the girls 
in the program achieved only small gains. The results of the analyses also 
did show that both PEP and control group students scored significantly higher 
on the posttests than- the pretests on Jhe Language Arts and Reading tests, 
but u..ly the PEP participants scored significantly in Mathematics. 

The second objective was measured by analyzing the outcomes ofjschool 
adaptability of the PEP students as compared with the control groupj PEP 



'participants^had a significantly lower absence and tardy rate than thfeir. 
counterparts in the control group . The rate of absences per student jfor the 

. PEP students was under five days for the school year. Similarly, the tardy • 
rate was extremely low. The third variable used to measure school adapt- • 

. ability was the cumulative grade-point averages. . The grade-point averages 
of both the PEP and control groups were quite similar with no significant 
differences between these two groups of students. 

In response to a survey, the students, as a group, perceived PEP quite 
favorably. Their parents, likewise, gave the program a good rating. Both 
grotips did express apprehension about the opportunities for PEP* students to V 
participate in extra -class activities'. The students' responses also indicat- 
ed some reservations about their educational experiences being located bo'th 
at the high school and the university. 

The results of this evaluation 'suggest that the' criteria for the selec- 

' tion of the PEP participants and the adjustment of the students "matriculating 
in two diverse educational settings needs review. This review may also pro- 
vide insights on decreasing the attrition rate from PEP. 
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SECOND YEAR EVALUATION OF*THE 
' ' PILOT ENRICHMENT 'PROGRAM (PEP) 

♦ * 
Introduction x 

1 " 

^The Pilot Enrichment Program (PEP) was funded by ESEA Title IVc 
and has completed 1 its ^ecoiuj year of operation, .This report is based 

on the results of the outside evaluation of PEP.for the 1979-80 year. 

f 

•Ninth and tenth grade students from Carver High School and ,Hyde 

P$rk Academy were the program participants. PEP was a response for - 

^the need to facilitate the improvement of academic competencies of 

minority students from lower income homes who exhibited outstanding 

i 

potential. Specifically, the' PEP project developed reading, writing 
and " computational skills of outstanding underprepared high school 
stud'ents ii^^rder to provide them with the ^academic tools necessary 
fbr matriculation in higher educaHon. 

The problems with public schools in large metropolitan areas are 
well publicized, though students with high academic potential are 
largely overlooked. Additionally, the needs oft black students .are 
even more critical as a result of discriminatory practices in large 
city public schools (Cooke & Baldwin, 1979). Too often, failure to • 
achieve in critical academic skills is masked by high grades which 
according to specific school standards are outstanding. However, many 
of them rank low on nationally standardized tests". 

The responses to providing a strong academic program in the large 

0 

city public schools are many. Yet, the success of any effort seems to 
center on -the need to pravide alterpativia programs which break away 
frojn traditional educational molds. In a broadly scoped article, 



Francis Chase of the University of Chicago, believes that programs that 
change from a prescriptive to a responsive or enabling curriculum along 
with the utilization of the total urban environment, provide the most 
favorable prognosis for stronger academic programs (dhase, 1979). 

The design of PEP utilized the suggestions .of Chase* That is, 
involvement with a university provides opportunities for curriculum 
innovations, and the utilization of the vast resources of Chicago 
offered students educational experiences not available in more tradi- 
tional settings. The need to offer gn alternative program enables , * 
students to receive educational opportunities beyoxtf which they have 
.experienced previously. Exposure to alternative modes of ' instruction 
and activities are needed so their abilities are challenged in less 
prescriptive settings (Rohwer, 1980). 

The staff of PEP included professionals from both the high school 

and university levels. Bringing together the talents of a variety of 

professionals, utilizing the community resources of a large city, and • 

obtaining strong parental invalvement were the ingredients of the PEP 

project. . 
6 

Program Description m K 

The PEP project operated both during the academic year and the 

summer session. The classe^were held three days a week at the students 

respective high school and for the remaining two- days at the University 

of Chicago. ^ * 

Students spent Monday, Wednesday and Friday- at their home high 

school enrolled in math, English and science classes conducted as 



80 minute double period blocked classes. Social studies and foreign 
language were single period classes of 40 miputes. 

Each Tuesday and Thursday, the students attended classes at the 
University of Chicago in reading, language arts and mathematics which 
reinforced and enrichecf their academic activities at the home high 
schools. Each class was programmed for 90 minutes with about 45 
minutes devoted to lectures-discussions, and the remaining time was 
spent iif a wide range of academic activities. Approximately 15 
students were enrolled in each class with' grouping based on standard- 
ized achievement te^t scores. 

Integral parts of the program were field trips, tutorials, art, 
music, physical education and related activities. These activities 
were programmed at regularly scheduled intervals throughout the school 
year. These courses were taught by teachers from the two participating 
high schools, by state certified teachers, and university graduate 
assistants. Upon completion of formal instruction, students were 

encouraged to use the University of Chicago library and participate 

* • ' 

in tutorials. It should be noted tha/fc students returned to their 

f N 

respective high schools for extra curricular activities. 

^ Tl)a^3tudents participate^ in anight week summer session 
preceding the 1979-Qp school year "with classes held four days each 
week. On each Friday and Saturday, students were given opportunities 
to be involved with tutoring, field trips, camping, college trips- and 
other special activities. During the summer session,* students enrolled 
in classes which provided intensive instruction in*the major subjects 



♦ of study including English, mathematics, and science. Participants 

i 

*vere placed in 'sections according to the results of^diagnostic tests, 

♦PEP provided a wide array of counseling by the staff which was 

*•% - 

designed* to assist- the students with both identifying an4 resolving 
problems^ opportunities.' Specif icaily, counseling was di^cted 
towarjr specific cfpmponents associated with higher education. They 
were also offered guidance in selecting college campuses to visit. 
>Additionally, the "Guest Table, 11 an informal lu^pheon program,*gave 
students an opportunity to interact with speakers representing a Variety 
*of occupations and backgrounds. 

^During the 4ca^&ic schopl year parental involvement was a vital 
feature of PEP. Parents met each month with the PEP staff. At the 
meetings, parents were provicfed-^rtfh "information about PEP and with 
opportunities \o meet with the staff to discuss, the academic progress 



of their child.* 

i 



The progress of the students was closely mc^Litored. To ensure 
maximum effectiveness of the program, each PEP participants was 
reassessed in the spring by the program staff and the teachers in * 
his/her home high school. The student must show strong academic 
progress and a high level of motivatioy to be eligible to continue 
in the program for the next academic year. 
Purpose \ 

The PEJ? project was designed to develop an intensive college 
preparatory program for underprepared lower income high school students , 
The project, combined the resources of Ofirver High School and Hyde I^ark 
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Academy along with the University of Chicago. Improvement of reading, 
literacy and academic skills along with activities to enhance motivation 
and interest in college were integral features of the program. 
Organization of the Program 

The staff ot the PEP project included: 

• » 

1. Program director, 

2. v Program coordinator, 

3. * University of Chicago coordinator, 

4. Teachers for major subject instruction, 

5. 1 University of Chicago instructors, and 

6. Program secretary. 
Mjr. Alexander Whit-field, principal of Carver High School, was the program 
director. Mr. Weldon Beverly is the principal of the other cooperating 
school, Hyde Park Academy. &rs. Carol Gearring was the program coordi- 
riator and Mr. Larry Hawkins, Director of Special Projects at the 
University of Chicago, served* as liaison with the two high schools, 

the University of Chicago, the community and the Chicago /Board of 

Education. During, the first semester, ^^^Lgh school teachers, two' 

fcromeacH of the cooperating scljools, taught on Tuesdays and Thursdays 

at the University of Chicago. For the second semester, three teachers 

served in this role. Counseling was provided by the two "high schools 

and the University of Chicago. ^ 

» 

Objectives 

The objectives, activities and evaluation procedures are listed 
on Table 1. The table includes the two objectives of PEP. The first 



Table 1 

» 

4 

Objectives, Activities, and Evaluation Procedures of PEP 



Objectives 



Activities 



Evaluation 



1. Selected 9th and lQth 
grade students Kom the 
target schools (PEP 
participants) will 
increase their communi- 
cation and computation 
skills at the .05 level 
-of significance, by 
June 1980, compared to 
control group students, 
as measured by the Iowa 
Tests of Educational 
Development ; Form X, 
1971 edition. 



1. Students will: 

a. Be programmed into 
honors level classes 
at their home schools 
five (5) days per 
week (Monday thru x 

" Friday) . * 

b. Be enrolled/blocked 
programmed into^the 
division of one rof 

-the released time 
teachers selected 
for participation in 
this project. 

c. Attend enrichment 
classes/college 
courses on the Chicago 
State University two 
(2) hours per day, 

- five (5) days per 
week. - 
d» Enroll in/attend 

v eight, (8) week summer 
session. 



1. In July 1979, the Iowa 
Tests of Educational * 
Development , Fori^ X 
1971 edition, will be ' 
administered to PEP 
participants and the 

» control group. 

2. In June 1980, the ~ Iowa 
Tests of Educational 
Development , Form Y w 
1971 edition will be 
administered" to trie 
PEP participants and 
the control group as a 
posttest . 
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Obj ectives 



Table 1 continued 



Activities 



Evaluation 



2. PEP participants as a 
group will demonstrate 
greater adaptability to 
the high school environ- 
ment as evidenced by 
significantly higher f 
(.05) grade point 
averages, lower rates 
of tardiness and 
absence as compared 
with the control group 
each semester. 




1. Students will learn: 
a) how to actively^ 
participate *n intro- 
ductions of and dis- 
cussions with guest 
speakers; b) how to 
actively pursue their 
own academic and cul- 
tural' interests; c) > 
how to interview; 
d) how to participate 
in ^jfeer counseling and 
pee'r tutoring, 
^^tudents will' receive 
Instruction in: peer- 
counseling, peer- % 
tutoring, questioning* 
strategies, public 
speaking. 
3. Students will partici- 
* pate in field trips,; - 
cultural and recreational 
act ivit ies ; introduce 
guest speakers; partici- 
pate in independent 
scheduling ; use . camptss 
resources^ tutor younger 
students; assist in 
program planning, t j 
implementing, and ^ 
evaluation. v 



1. Number of tardies and 
absences of the PEP 
participants and the 
control group will be 
compared . 

2. The grade point averages 
of the PEP and the control* 
group will be compared. 



objective focused on the cognitive component of the program as measured 
by the 'Iowa Test5of Educational Development , The second objective 

, Included selected behaviors of the PEP students which were grade-point 

■*> 

averages, § school attendance and tardies. 

Evaluation . - 

The evaluation design was based on the measurement of the two 
program objectives. For objective one, academic achievement was 
measured with the Iowa Tests of Educational Development , Form X, 1971 
Edition (ITED) . This achievement battery* is designed for senior high 
school students and measures performance in high school subjects. 
The battery includes six subtests which are Reading, Language, 
Mathematicgjjfsocial Studies, Science and Source Usage. In addition 
to # subtest, scores, a composite score is provided. ^*>^ 

Since the objectives of the ITED were written to reflect the 
content of academic programs in common use throughout "the- nation, ITED 
can be said to^be valid for 'measuring these common objectives. These 
objectives reflect the educational goals of the PEP project. The 
reliability estimates* of ITED range f rom x >&5_to^9? for pa^llel 
forms, while validity estimates r^nge from .5(T^o~7(&^ 
is correlated with school grade point averages. * 

The ITED was analyzed in this project by utilizing Reading, 
Language Arts, and Mathematics subtests. The remaining three subtests 
on the ITED (Social Studies, Science and Source Usage) were not 
completed by the PEP participants baaed on the data that the evaluator 
received from the PEP staff. With thigte subtests being reported, the 
composite results were not included. 

17 



The scores on the ITED were shown* in' terms of growth scale values. 
, 6 publishers of the achievement test, Science Research Associates, 
t^elieve that grade equivalents do not; seem appropriate at the secondary 
school level. Diversification of curriculum areas ancf widely varying 
student interests which leads^to differing emphasis in subjects make 

9 * 

grade-equivalents as the standard scores have questionable value. 

The advantage of the growth scale values is that scores can be charted 

over a period of time which has relevance to this evaluation which 

4 C 

utilizes pretest and posttest scores. A 

i 

The ITED was administered to the PEP participants and a control 
group in September as a pretest, and readministered to the two groups 
on May 29 and 30 as a posttest. The batteries were administered by 
professionals in the two' participating high schools. The posttest 
administration 5 was also monitored by one member of the evaluation team. 

The following variables were analyzed to measure objective two: 

1. The grade-point average? of each student were comprised 
of the four major subjects. * 

,2. Attendance and tardies were compiled for each student. 
The data for both variables were compiled from school records by the 
PEP staff. ' 

Questionnaires were administered to the PEP staff, students and 

■ * 

parfents of the students to obtain their perceptions of the program. 

'>. 

These instruments were 1 administered in May, and were a source of 
additional data beyond what yas measured by the two objectives. 
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Analysis of Data 

Each analysis in this evaluation of the two objectives In this - 
project included a comparison of the ?EP participants (treatment 
group) and a control group. The results of the pretest and posttest 
Iowa Tes tsof Educational Development (ITED) scores as prescribed by 
Objective One were analyzed by performing three (3) three-way analyses 
of covariance. The independent variables were student group ftreatment 
and control group), grade level (nine and ten) and sex. Even though 
the measurement 'of the grade level and sex variables were not pre- 
scribed in Objective One, it appeared that these two variables might 
provide data that would help the PEP staff in evaluating their 
instructional program. Th4 dependent variable was posttest achievement 
subtest scores (Mathematics, Language Arts, and Reading). The covariance 
in each of the three-way ^nalyses w*is the respective pretest achievement 
test scores. Follow-up analyses included reporting mean scores, < 
standard deviations, and two-tailed t-tests whenever appropriate. 

Analysis of covariance (ANCOVA) *is a statistic that tests the 
significance of the differences between means of final experimental 
data by taking into 'account* the* correlation between the dependent 

variables and a chosen covariate. The outcome of a covariance statistic 

) 

is that initial differences in the dependent variable ar£ accounted for 
and adjusted appropriately. The importance of an ANCOVA lies in the 
choice of a measure that is directly related to the dependent Variable 
which, in this application, is the pretest score. 
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^ The attendance, tardies, and grade-point average variables were 
subjected to t-tests. Each of the three variables were totaled and 1 
differences between the control and treatment group means were ' 
analyzed. 

Popul ation * <* 

The population data of the PEP participants and the control group 
are shown on Table 2. An overview of the table indicates that 73 
students were included in this evaluation. Hyde Park Acfdemy had 48 
students enrolled in PEP as compared to 25 students from Carver High 
School. Also noted is that 64% of the population was female. 

» 

Table 2 

Population Data of the PEP 
and Control Groups 



Group 

s 


Number of Girls 


Number of Boys * 


1 

1 Total Number 


PEP 


47 


27 

/ * • 


• Y 73 


Control 


34 


17 


. 51 










Attrition 


from PEP was an important 


factor from the 


beginning of 



the year. Within a few "weeks of the school year, ten Carver freshmen 
-dropped from the program. All ten werftyiot involved in the "Summer 



program. By November 1, two more Carver students had dropped from the 
program. After that date, seven' (7) additional Carver students left 
PEP. Two students from Hyde Park djfepped from the program. The 
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dropouts apparently lacked motivation and the academic ability to stay, 
in PEP. 

» 

The procedure used* to identify members of the treatment and control 

group was as follows: a pool of all possible candidates was created and 

from this, a group of students was identified expressing willingness to 

participate in the PEP project^ The remaining students became the 

control group. -The selection of a control t group for a study of -this 

type {3 exceedingly difficult. The control group should be as nearly 

comparable to the experimental (PEP) group as possible, however, the 

population pool from which to select comparable groups is limited . To » 

select students from schools not participating in the PEP project adds 

a series of variables that make comparisons not meaningful. A total of 

13 control group students were dropped as a result of incomplete data. 

If two of the following were not available, the student was not included: 

1) ITED scores, 2) GPA, and 3) absences and tardies. -The remaining 51 

students in the control group were not comparable on the sex and grade 

level ^variables. ^ A series of two-tailed trtests were completed" which 

compared the PEP participants with the control group on pretest Reading; 

Language Arts and Mathematics achievement* test (ITED) scores. In each 

test; the PEP students had significantly higher scores than the control 

1 — 
group. Tables 3, 4 and 5 show the results of comparing the treatment 

(PEP) and control, groups on pretest achievement test scores in Mathematics, 

Language Arts and Reading. A two-tailed t-test was performed in each 

comparison to ascertain significance level. 



Table 3 ^ 

Comparison of PEP Participants and Control Group 
on Pretest Reading Achievement Test Scores 



Group 


Number of 
\ Students* 


h — 

Mean 


Standard 
Deviation 


t-test 


PEP 


73 


407.33 


36.47 




Control 


51 

V 


385.39 


46.37. 


2.82* 



*p < .01 



Table- 4 

Comparison "Of PEP Participants and Control Group 
cm Pretest Language Arts Achievement Test Scores 



l 

J 

Group 


Number of 
Students 


« 

Mean 


Standard 
Deviation * 


. \ 
■ t-test 


PEP 


73 


415.51 


44. 33^ 




Control 








3.73*,, 


51 


384.08 


47.34 








\ 







*p < .01 
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Table 5 

Comparison of PEP Participants and Control Group 
v on Pretest Mathematics Achievement Test Scores 
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Group 


Number of 
Student^ 


Mean 


Standard 
Deviation 


\ t-test 


^PEP 


73 


424.89 


64.93 


-T- 


Control 


51 


378.39 


58.79 


4.15* 



*P < .001 



Results 

The tables that follow show the data that were collected by the 
outside evaluators since December 1979. The analyses of findings are- 
organized 'on the basis of . the objectives of the program. The written 
analysis for each tab^e offers conclusions about the* data sind points 
out selected data whl^ch offer informative perspectives about the 
program. ' , / * 



Objective One 



t 



r 

Selected 9th and 10th grade students from the target . 
schools (PEP participants) will increase their communication 
and computational skills at the .05 level of significance, 
,by June 1980, compared to control 'group studehts, as 
measured by the Iowa Tests of Educational Development . 
Form X, 1$71 edition. * 

■ As indicated previously, the PEP participants and the control group 
we__j administered the Iowa Tests of Educational Development (ITED) as a 
pretest in September, 1979 and as a post test in May, 1980. The analyses 
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,^}Enc 



included the results from the Reading, Language Arts, tod Mathematics 

achievement test scores. 

A three-way analysis of covariance (ANCOVA) was performed for each 
o^-the pjetest and posttest achievement test results comparing the PEP 
and control groups. The covariate in each ANCOVA was the pretest score 
and the dependent variable was the posttest score; The three inde- 
pendent^ variables^ were studeivt group (PEP participants vs. control 
group), grade level (nine a^l ten) and £ex. 

Table 6 shows the analysis of covariance summary results of the 
ITED Reading pretest and posttest score differences for the PEP 
participants and the control, group. None of the three independent 
variables, student group, grade level and sex, were found to be 
^ significant. No significance was f^und^in . either the two-way or three- 
way interactions. The covariate was significant at the .©0i«4^vel 
indicating it was a suitable variable to adjust for the posttest:" 

rekding scores. V - * * 

* i 

TabMs 7 and 8 show the, mean scores, standard deviations aild t-tests 

f 

of the pretest. and posttest results on the Reading achievement test for 
the PEP and control groups, respectively. The data on the two tables 
show that both groups of students scored significantly higher on the 
posttest than the pretest. The proportion of score gains were about t^J? 
same for each group. 

A summary of^the three-way ANCOVi^n the Language Arts ITED 
achievement test is shown on Tabie 9. The covariate was significant at 
the .001 level. Pretest and posttest Ifetfguage Arts test mean scores 
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Table 6 

Summary of Analysis of Covariance on Pretest and Posttest 
Reading Achievement Scores by Student Group,- 1 
Grade Level and Subject Sex 



Dependent Variable 



Source 



Significance 



Posttest scores 



Student group 
Grade level 
Sex 

Pretest scores 



.082 

# 

.87 
.002. 
120.988 



NS 
NS. 
NS 
.001 



Table 7 

Pretest and Posttest Scores of the PEP 
Participants on Reading Achievement 



Test* 


Number- of 
Students 


Mean 


Standard • 
Deviation 


i 

t-test 


Pretest 

* 




406.51 


36.05 




Posttest 


72 






2.'9t* 


/• 


415.60 


33.31 



*p < kOl 



Table 8 



Protest and Posttest Scores of the Control Group 
on Reading Achievement 



f 

Test 


Number of 




Standard 




Students 


Mean' 


Deviation 


t-test 

c 


Pretest 




386.17 


50.43 > 






47 a 






2 .h* 


Posttest 




402.15 


38.36 













*p < .01 

I 



Table 9 

Summaty of Analysis of Covariance on Pretest and Posttest 
tanguage Arts Achievement Scores by Student Group; 
% ■ Grade Level and Subject Sex - ** 



Dependent Variable 


—+ 

Source 

*■ 


F 


• 

Significance 

9 


Posttest scores 


Student group* 


1.64 


NS 




Grade level 


.75 


NS 


r 


Sex 


.31 


NS 




Pretest scores 


171.09 


.001 

-> 
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were found not to be significant across" all three independent variables 
(student group, grade level and sex). 'No significant interactions ^were 
found. * * 

An observation of Tables 10 and 11 which record thk results of the 
Language Arts achievement tests for the PEP and control groups, respec- 
tively, shows that score gains were made for the school year when 
comparing the posttest and pretest results. " As with the Reading 
/ /achievement test scores, the gains were significant. However, the 

score gains of the PEP participants were greater than the control group 
* based on the t-test results. 



Table 10 

Pretest and Posttest Scores of the PEP* 
'Participants on Language Arts 
Achievement 



9 



Test 


Niitaber of 
Students 


Mean 


Standard 
Deviation 


t-test 


Pretest 




415.21 


44.57 






72 






3.77* 


Eosttest 


> % 


* 429.07 


42.76 





*p < .001 
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Test 



Pretest 
Posttest 



Table 11 

Pretest and Posttest Scores of the Control Group- 
on Language Arts Achievement 



Number of 
Students 



47 



Mean 



387.80 
399.17 




t-test 



2.30* 



*p < .05 



The results of comparing the treatment (PEP) and the control 
group on 'the Mathematics achievement test on the ITED with a three- 
way ANCOVA are shown on Table 12. Unlike the two previous achievement 
test results (see Tables 6 and 9) , significant results were found for 
the student group, F - 9.42, p < .01, and sex, F - 4.61, p < .05. The 
third independent variable, grade level, was found not significant. 
The two-way and three-way interactions were found not significant. 

Tables 13 and 14 show the pretest and posttest Mathematics 
achievement test scores of the PEP participants and the control 
group, respectively... The PEP students-mada significant gains at the 



.01 level, but the control score gains was found not tp be significant. 
As ^previously indicated (see Table 12), the three-way ANCOVA 

results for mathematics indicated significance on the sex variable. 

\ p.* '*** 

Four follow-up t-fcests were completed to gain some insight on the 
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Table 12 . - 

• * * 

Summary of Analysis of Covarianc'e on Pretest and Posttest 
Mathematics Achievement Scores by Student Group, 
Grade Level and SubjeGt Sex 



Dependent Variable 


Source 


F 


Significance 


Posttest scores 


Student group 


9.417 ~ 


.01 




Grade level . 


.002 


. NS 




Sex 


4.607 


.05 




Pretest scores 


93.36 


.001 



Table 13 

Pretest and Posttest Scores of the PEP 
Participants on Math Achievement 



Test 



Number of 
Students 



Mean 



Standard 
Deviation 



t-test 



Pretest 
Posttest 



72 



424.04 
448.93 



64.98 
57.83 



3.68* 



*p < .001 



r 



*w yJ 



*k ; V Table 14 ' ' • 

Pretest and Posttest Scores of the, Control Group 
on Math Achievement 



Test 


Number of 
Students 


Mean 


Standard 
Deviation 


t-test 


Pretest 
Postte^ 


47 


384.56 • 
394.51 


60.89 
' 68.97 


1.28 



Source of the significance. The results for the females are shown on 
Tables 15 and 16. Tables 17 and 18 show the test results for the males. 

i 

A perusal of Table 15, which presents the pretest and posttest • . 

Mathematics achievement test results, shows that the score gains for 

the females in' the PEP project were nonsignificant. A study of 

Table 16 indicates that the score gains of the females in the control 

« * 
group were also nonsignificant, and this group even made proportionally* 

less gains than their counterparts in PEP. 

The males in PEP made significant pretest to posttest score gains 

at the .001 level as shown in Table 17. However, the results on 

Table 18 show that the control group males d,id not achieve significant 

score gains on the Mathematics achievement tests. Thi£ indicates that 

a good portion of the score gains in Mathematics for the 'PEP students 

was maHe^by the males; To summarize, the PEP participants scored 

significantly higher on the posttest than the pretest Mathematics test. 

30 . \ 
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r 




{ Pretest and Posttest Scores of the PEP 
•Females on Math Achievement 





Test 


Number of 
Students 


« 

Mean 


Standard 
Deviation 


t-test 


> 

f 


Pretest 
Posttest 


46 


428.43, 
^44^57 


6K44 
57.24 


1.81 



Table 16 

Pretest and Posttest Scores of the* Control Group 
Females on Math Achievement 



J, 



Test 


Number of 
Students 


Mean 


*■ Standard 
Deviation 


t-test 


Pretest * 




373.08 


49.79 










53*. 64 


0.82 


Posttest . 


_JL_ 


* 382.60 
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Table '17 ' * 

Pretest and Posttest Scores of the PEP 
Males on Math Achievement 



Test 


Number of 
Students 


Mean „ 


0 

Standard " 
Deviation 


t-test 


Pretest 




416.27 


71.40 






26 






- 3.67* 


Posttest 




460.19 


* 58.26 





*p < .001 



Table 18 

Pretest and Posttest Scores of the Control Grou^' 
Maiftg^ on Math Achievement 



Test 


Number of 
Students 


Mean 


Standard 
Deviation 


s- 

t-test 


Pretest 




402.50 


73.19 






16 






1.21 


Posttest 

r 




413.13 


86.45 













no 

t 



\ 
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However, the PEP males made much larger gains than the females in the 
program. 



Overall, on Objective One, no significant differences were found 
y between pretest and post test Reading and Language Arts achievement 

tests when PEP participants were compared with the control group. 
On the Math subtests, the PEP participants did make significant 
pretest v^o posttest gains, while the control group failed to reach 
significance. Additionally, the PEP males made significant score 
gains while the female gains' were not significant. . 
Objective Two 

PEP participants as a group wifl demonstrate greater 
adaptability to the high school environment as evidenced 
bf significantly (.05 level) higher grade-point averages, 
lower rates of tardiness and absences as compared with 
the control group. i 

School attitudes are* difficult to assess 'and the standardized 
tests that have been developed are often subject to socially desirable 
responses by the respondents. Consequently, it was decided that grade- 
point averages, number of school ^absences and tardies were 'the best 
available indicators of attitudes and adjustment to senior high school. 

The data on Table 19 show * the t-test results* from comparing the 
PEP participants with the control group on total tardies for the 
school year. Both groups of students had very low tardy rates and 
significant differences were found with the PEP students having a 
lower rate. 

v 

The difference in the absence rate for the PEP participants and 
the control group was even more distinct than the tardy rate. The 
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Table 19 . 

Comparison of PEP Participants and the Control Group 
on. Number of Tardies for the School Year 



■J 








A 




Group 


Number of 
Students 


' Mean 


t 


Standard 
Deviation 


t-test 


PEP 


72 


.15 




.62 




Control 


51 


.90 




1.58 


3,23* 



*p < ,01 



average nunjber of days absent for a PEP student was slightly more than 
4h days forythe school year. This compared with nearly 12 days of 
absences per control group student over the same time span (see 
Table 20), In fact, the absence rate of the PEP student appears 
outstanding when compared with most other groups of high school 
students. Additionally, the absence rate of the PEP participants 1 
and the control group was statistically significant at the .001 level. 

Grade-point averages were based on the four major subjects in 
which the student was enrolled. A two-tailed t-test was completed ■ 
to measure differences between the PEP participants and the control 
group on grade-point averages. An "A" In an honors class was scored 
as five points. The PEP participants Received slightly higher grades 
as a gifoup than the control group, but the differences were found to 
be not significant (see Table 21). A perusal of the grades earned 
by the students indicated that, tenth graders in PEP received higher 



Table ?0 

Comparison of the PEP Participants and jthe Control Group 
•on Number of Absences for the School Year 



Group 



Number of 
Students , 



Mean 



Standard 
Deviation 



t-test 



PEP 

Control 



72 
51 



4.74 
11.90 



4.72 
10.85 



4.43* 



*p < .001 



Table *21 

Comparison of the PEP Participants and the Control Group 
on Cumulative Grade Point Averages 
for the School Year - 



Group 


Number of 




Standard 




Students 


Mean 


Deviation 


t-test 


PEP 


72 


3.20 


.96 




Control 


51 


3.08 


1.18 


.58 
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grades than their ninth grade counterparts. Most of the subject 
failures by the PEP group were in foreign language courses. 

The findings on Objective Two point out that the PEP participants 
had a significantly better attendance record and tardy .rate that*, the 
control group. Though significant differences were found on comparing 
the two groups on number of tardies, the rate was low for both groups. 
The PEP students' grade-point averages were a shade*igher than the 
control group, but the differences were nonsignificant*. 
Questionnaires 

In addition to measuring the outcomes of Objective One and Two, 
PEP students, their parents, and the PEP teachers were each given a 
questionnaire to solicit their perceptions about the project. Three 
questionnaires, one for each of the three targeted groups, were 
designed^ by the^ outside evaluators and approved by the Board of 
Education. 

Each paren/was mailed by' first class a cover letter explaining 
the purposes of the questionnaire, the questionnaire and a business 
reply envelope (see Appendix A). Seventy-nine letters were delivered 
and 19 parents responded which is a 24 percent return rate. 'A * 
follow-up of the nonrespondents was attempted by hand delivering • 
another set of questionnaires which were distributed at a parents' 
meeting. No additional data were received from the follow-up. 
Table 22 gives a summary of the parental responses, 
q^jlnterestingly, the responses to questions 1 through. 6 show an 
overwhelming favorable opinion toward PEP by the nineteen parents 
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Table 22 
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Parents 1 Perceptions of PEP (N » 19) 



Percent Agree and 
Item Strongly Agree 

1. I believe that my child is more interested 

, in school since being enrolled in PEP. 73. 72 

2. I have had enough opportunities to be 

involved with PEP. 73.7 

3. The summer program is a useful part of PEP. 84.2% 

4-. M7 child benefits more from taking cour^jp 
at the University of Chicago two days aW 
week instead of remaining all week at the 78.9% 
high school. * 

5. I want my child in PEP for another year. 84. 2% 

6. There has been adequate information given 

about PEP. 73. 7% 

•> 

7. My child has sufficient opportunities to 
participate in regular school activities 

that take place outside of class (fine 42.12 
arts, physical education f student 
government 9 etc . ) . 



who responded to the survey. The last question on the instrument 
(Question 7) provides an indication that parents are uncertain- about 
the advisability 6f ^program which limits .their child's extra- 
curricular activities. 

r Aa indicated on Appendix A, parents were given an opportunity to 
answer the^fotlowing open-ended question, "What is the most important 
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benefit that your child is receiving from PEP? Of the 17 parents who 
responded, four have been randomly selected, 

Respotise>i^ f, The most impo^^t/benefit my child has received 
from PEP is an opportunity to^be on a university campus 
with be^t of people.... 11 
Response 2: "The strong emphasis on academics and early 
exposure to places of higher learning Wde my son 
realize that in order to get into the better colleges 

and universities he has to plan ahead ^and that his 

• * 
number one priority is his academic courses from his 

first year of high school...." / 
Response 3: "Tutorial services and an opportunity to take 

national achievement test." 
Response 4: "The only thing that I can see is that she likes 

school more." 

During late May, the students in the program completed a question- 
naire which was designed to elicit * students • attitudes toward the program 
The questionnaire (see Appendix B) consisted of twelve questions, each of 
which required the student to circle the choice reflecting their point pf 
view. Each student was also requested to indicate sex and class by 
checking the appropriate blank. The results from the questionnaire 
indicated the following: 

Carver High School ■ 24 
Hyde^ Park High School - ,48 
Total N -72 
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Tafrle 23 gives a summary of the results of the students' responses to 
the questionnaire (see Appendix B) s* 

Table 23 
Students -Perceptions of PEP 



1 Percent Agree and 
Item « Strongly Agree 

1. I believe my attitude toward school has improved 

since I have been in PEP. t 64.8% 

2. I found the summer program helpful in improving 

my attitude toward school this year. (Don't 48.3% 

answer this if you did not attend summer school.) 

* 

3. I believe that the extended class periods (80-90 

minutes) at the high school and the university 61.9% 
helps me with my school work. 

4; My parents believe that PEP is a good program.^ 80. 7% 

5. I would recommend PEP to my friends. 45.1% 

6. I believe that going to the University for two 

daya each week does not interfere with my school 21.1% 
activities at th*± high school. ^ 

7. I have found my classes at the high school more 

worthwhile than at the university. , J 70.7% 

8. PEP students are given sufficient recognition for 
outstanding accomplishments at the high school. 34.4% 

'9,. I have sufficient opportunities to take part in 

school activities (physical education, music, 8.4% 
art, etc.). 

10. I would like to enroll .in PEP for another year. 50.6% 

11. I feel that my teachers are inteitested in * 

* heljring me become a better student. 74.7% 

12. I have enough time to study in school. * 32.4% 



Question 9 sterns to_ represent a consistency between the parental" 
attitude and student attitude. That is, both groups seem to feel that 
the program limits' the students' involvement with extra-curricular 
activities. Perhaps the necessity for travel time and the increased 
level of home work prevented students from participation. 

A rather stunning result is the answer to Question 10 which 
focuses on whethey ,or. not the students .want to participate in PEP ^ 
again next year. Specifically, 50.6% agreed or strongly agreed with 
the statement (Question 10). ' Reviewing the data in more detail, 95. 7% 

of the students at Carver express disagreement or strong disagreement 

with the statement. By contrast, 27. 1% of the students at Hyde Park 

express disagreement or strong disagreement. 

Reviewing tjhe results from Question 5 (I would recommend PEP to- , 

my friends) in mo^re detail seems to support the above finding. 

Specifically, 10.5% of the Carver population agreed or strongly 

agreed while 60.4% of the Hyde Park respondents gave favorable 

responses • 

Responses 6, 7, 8 and 9 focused on the students' views of. the 
University of Chicago componer^ of the project, and it* relationship / 

to participation in activities ^ their home high school. A perusal 

v 

of the percentage of agreements with these four statements indicated 
some apprehension about the University experience ataong the PEP 
participants. Probably, the students identified strongly with their 
high school and their friends. Reaving the high school environment 
may have generated some less than enthusiastic support. 



The ^valuators distributed a questionnaire to each of the teachers 
in the project (see Appendix C) . Surprisingly, only one teacher took ' 
the necessary time, to complete the- questionnaire. The questionnaires 
were given the teachers with a cover letter and ^a -business reply 
envelope for their convenience. The comments prepared by the one 
teacher were essentially positive. Sn^no other responses were 

available, the evaluators can not form any judgments relative to tfts 

views held by the teachers.' 
Summary of Results 

PEP during this year was an intensive college preparatory project 
for ninth and tenth graders who had exhibited outstanding academic 

potential. Students from the two participating high schools, Carver 

*«* - 
and Hyde Park, spent two days a week at the University ' of Chicago 

which enabled them to participate in a wide range of cultural and 
educational enrichment activities. Achievement of greater academic 
skills along with Improving their attitudes toward school were, in 
summary, the two ^b^ectives of PEP. 

^ This evaluation analyzed the academic achievement and the 
adaptability to high school of 73 students -in PEP. ' The majority of 
participants were girls and, as a group, PEP students had an academic 
^background which indicated "a good potential for pursuing a collegiate 
education successfully. A control group* of 51 students from the two 
participating PEP high schools was utilized for comparison with the 
PEP participants on each of the outcomes analyzed in this report. 
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Academic achievement included comparing PEP Students with the 
control group on pretest apd posttest scores on Reading, Language 
Arts and Mathematics tests of the Iowa Tests of Educational Development , 
No significant differences were found between the two groups of students 
on the Reading and Language Arts achievement tests. However, significant 
differences^ were found on the Mathematics achievement subtest favoring 
the PEP participants. # Much of this statistical difference occurred 
because PEP males scored significantly higher on the posttest than the 
pretest.' Follow-up t-tests also indicated that both the PEP and control 
groups scored significantly higher on the posttests than the pretests on 
the Language Arts and Reading tests, but only the PEP scored significantly 
higher in Mathematics. *~ - 

The second objective measured the outcomes "bf school adaptability 
to the PEP students compared with the control group. PEP participants 
had a significantly lower absence rate than their counterparts in the 
^ control group. The mean of absences per student for the PEP group was 
under five days over the school year which is aft excellent record. 
Similarly, the tardy rate was extremely low. The third v^fciable used 
tp measure school adaptability was -cumulative grade-point average. 
The-grade-point averages of each group were quite similar with no 
statistically Significant differences. Grade-npoint averages are a 
subjective variable in that teachers do vary^to a great extent on the^ 
determination of graces,. However, good school attendance is a prime 
indicator of satisfactory adjustment to school. High rat/" Df absences 
is often an indic^or that a student is losing interest in school 



suggesting that the absence rjrre of each student must be carefully 
monitored. 

A survey of opinions about educational programs has been accepted 
as the most efficient and effective procedure for obtaining views about 
educational programs. Those parents who responded to the evaluators 1 
designed questionnaire gave strong approval to the PEP, except they 
believed that the^|tudents may not have had sufficient opportunities 
to participate in extra-class activities in their home high school. 
Over 90 percent of the students supported their parents' views on the 
status of participation in high school activities. 

Overall, the students perceived PEP favorably, though as a group 
they did express some reservations. Basically, the concern revolved 
around the portion of the program operated at the university. 
Attendance on a university campus is a sharply different experience 
than attending public schools. Educators may have overestimated the 
V- ability of the ninth and tenth graders to adjust to a university 
campus. Expectations may be different in both the academic and 
social realms. It does appear that the students want a stronger 
identity with their home high school. 
Recommendations for Project, Activities 

1. The identification and selection of PEP participants needs 
clarification and a statement of criteria necessary for selection 
should be made available. 

2. The selection of a comparable population of students to serve 
as the control group presents a continuous problem. It is desirable 
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that the students in the control group be enrolled in the same high 

schools as the treatment group (PEP) • However/ th^Ls goal is often > 

difficult to ^hieve for students in an accelerated program. Criteria 

for selecting the control group must include the variables utilized 

to measure the outcomes of the program objectives so that the students 
V 

are comparable with the treatment group, 

3. The students should be given more opportunities to provide 
input on the issues of accessibility of extra-class activities, to the 
PEP participants and the program at the University of Chicago. 

4» 3Jt is assumed that parents of the students are vitally 
interested in this accelerated college preparatory program. Yet, 
th^lsw response rate to the questionnaire about their views of the 



program does suggest that greater attention to parental involvement 
may have many benefits for PEP. Newsletters, invitations to student" 
programs and opinionnaires about the program might encourage greater 
parental involvement. 

5, The dropout rate from PEP needs attention. This involves 
an analysis of the criteria for selection of tlie participants (see 
recommendation 1), providing counseling attention specifically for 
students who did not attend the summer session, searching for reasons 
why the dropout rate centered on Carver High School students, which 
could include a study of transportation problems, differing backgrounds 
of students and a greater integration with the Hyde Park Academy 
student group. 
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6. ^Teachers should review their grading practices. The teacher 
marks appeared somewhat low and the subject failure rate, especially 
in foreign ^language, needs some scrutiny. 

7. The females in PEP* made only, small gains in mathematics for 
the school year as in3icated by the Mathematics achievement p|etest 
and postte^t results. A lack of confidence and a low interest level 
may well be critical factors in this lack of achievement. This 
prpblem is national in scope, and an innovative program as PEP should 
show leadership in breaking the cycle of low achievement in mathematic 

by females. • 

) 

Conclusion 

♦Overall,^ the results of the evaluation of the PEP project were 
quite positi\jp. The students had an outstanding attendance and 
tardy record which indicates a good adjustment and attitude toward 
school. ;They made good gains in their achievement tests scores in 
Language Arts, Reading, and Mathematics (with the exception of the 
females). 

y ■ 

P^P, as an alternative educational project, did face problems * 
that fortuantely can be resolved, at least to a degree. The dropout 
rate and the adjustment to the university campus as perceived by the 
students appear as issues that are most visible. An even greater 
degree of involvement by both students and parents on providing 
feedback about the program may well do much to alleviate the most 
pressing problems that PEP faces as a challenge. 
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APPENDIX A 

PARENTAL VIEWS OF PILOT ENRICHMENT PROGRAM (PEP) 



J 



PARENTAL VIEWS OF PILOT, ENRICHMENT PROGRAM (PEP) 
in Carver and H$ie Park Schools 
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Directions : Below are eight (8) statements. If you strongly agree wit 

oiJSf " ^ T? 1 ? disa 8 ree ' circle SD. On the eighth statement/ 
please provide a brief response. 



Your child is a freshman 
sophomore 



1. 

2. 

3* 
4'. 



5. 
6. 

7. 



8. 



I believe that my child is more interested in 
school sface being enrolled in PEP. 

I have had enough opportunities to be involved 
with PEP. 

The summer program is a useful part of PEP, 

My child benefits more from taking courses at 
the University of Chicago two days a week 
instead of remaining all week at the high 
school. 

I want my child in PEP for another year. 

There has been adequate v informat ion given 
about PEP. 

My child has sufficient opportunities to 
participate in regular. school activities 
that take place outside of class (fine arts, 
physical education, student 'government , etc.) 

What is the most important benefit that your 
child is receiving from PEP? 




> 

OQ 



CD 
0> 



A A D SD 

SA A D SD 
SA A D SD 



SA A D SD 

SA A D SD 

SA A D SD 

SA A D SD 
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M? VIEWS OF PEP 



Freshman Male 

Sophomore Female 



Your views on PEP are needed as part of the evaluation of this program. 
Below are a series of statements about PEP. Select one of the following 
responses for each statement that most closely reflects your view. 

Strongly Agree (SA) ^ Agree (A) Disagree (D) Strongly Disagree (SD) 



1. 


I believe ray attitude toward school has improved 
since I have been in PEP. 


SA 


A 


D 


SD 


2. 


I found the summer program helpful^in improving 
my attitude toward school this year. (Don't 
answer this if you did not attend summer schopl.) 


SA 


A 


D. 


sp 


3. 


I believe that the extended class periods (80-90 
minutes) at the high school and the university ~. 
helps me with ray school work. 


SA 


A 


D 


SD 


A 

4. 


« * 
My parents believe that PEP is a good program. 


SA 


A 


D 


SD 


5* 


I would recommend PEP to ray friends. 


SA 


A' 


D 


SD 


6. 


I believe that* going to the University for two I 
days each week does not interfere with ray school 
activities at' the high school. 


SA • 


A 


D 


SD 


7. 


I have found my classes at Jtfie high school mope 
worthwhile than at the university. 


SA 


'A 


D 


SD 


8. 


PEP students are given sufficient recognition 
for outstanding accomplishments at the high 
school. 


SA 


A 


D 


SD 


9. 


I have sufficient opportunities to take part in 
school activities (physical education, music, 
art, etc.). 


SA 


A, 


D 


SD 


10. 


I would like to enroll in PEP for another year. 


SA 


A 


D 


SD 


11. 


I feel that my teachers are interested in 
helping me become a better student. 


SA 


A 


D 


SD 


12. 


1 have enough time to study in school. 


SA 


A 


D 


SD 
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K As part of the evaluation of PEP, your views as teachers are an important 
part of this endeavor. ^Return the questionnaire in the attached envelope. 
, Please respond to each of the first nine statements by selecting one of 
the five responses provided with each statement. 



Strongly Agree (SA) Agree (A) Disagree (D) > Strongly Disagree (SD) 



1. 


y 

The 80 minute class periods provide greater 
flexibility' in classroom activities and 


SA 


A 


V 

D 


SD 


2. 


Sufficient time is given in teaching reading 


SA 


A 


- D 


SD 




The summer program is a vital component Qf PEP. 


SA 


A 


D 


SD 


4. 


Students have sufficient opportunities to 
participate in extra-curricular activities. 


SA 


A 


D 


SD 


5. 


Having class two days a week at the University 
is a benefit to the program. 


SA 


A 


D 


SD 


6. 


The longer class periods provide increased 
opportunities for individualized instruction. 


SA 


A 


D 


SD 


7. 


The 7EP students have developed a good rapport 
with each other. 


SA 


A 


D 


SD 


8. 


Not enough classroom time is given for some 
courses • 


SA 


* 

A 


D 


SD 


9. 


The students have sufficient time to study. 


SA 


A 


. D 


SD 



xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

10. On a 'scale o f t 1 to 10, I would rate PEP as follows: (circle ope) 
123456789 10 



Weak Average Outstanding 



r 



